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CN . Abstract 
> ■ 

v^ . We establish the connection between the Aubry-Mather theory of in- 

»«fs ' variant sets of a dynamical system described by a Lagrangian L{t,x,v) = 

f*^ , Lq{v) — U{t,x) with periodic potential U{t,x), on the one hand, and 

\^ • idempotent spectral theory of the Bellman operator of the corresponding 

l~:> ' optimization problem, on the other hand. This connection is applied to 

0^ ■ obtain a uniqueness result for an eigenfunction of the Bellman operator 

CTS ' in the case of irrational rotation number. 

a 

^ ■ 1 Introduction 



Consider a Lagrangian 



o 

CJ . L{t, X, v) = Lo{v) - U{t, x), 



where t, x eM. and the functions Lo{v), v G M, and U{t,x) satisfy the following 

S^ . conditions: 

Vh 

C^ ' (Li) Lo{p) is of class C^; its derivative Lq{p) is strictly growing: Lg{p2) > 

^o(Pi) iff P2 > Pi and has a locally Lipschitzian inverse. 

(L2) For any iV > there exists P > such that if p e R, \p\ > P, then 

Loip)>N\p\. 

(L3) U{t, x) is of class C^ and its derivative dU/dx is Lipschitzian. 

(Li) U{t, x) is periodic: U{t + 1, a;) = U(t, x + 1) = U{t, x) for all {t, x) eR'^. 

Let X, y, s, t e R, s < t. We say that the set of all absolutely continu- 
ous functions £,: [s,t] -^ R such that £_{s) = y, ^{t) — x, and L(-, ^(•), ^'(•)) 
is Lebesgue integrable, is the set of admissible trajectories (or trajectories for 
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short) and denote it by n{s,y;t,x). The functional defined on n{s,y;t,x) by 
the formula 

£is,y;t,xm^ f L(T,e(T),e'(r)) dr - / [Lo(C'(t)) - [/(r,C(r))] dr 

J s J s 

is called the action functional associated with the Lagrangian L(t,x,v). It 
follows from conditions (Li)-(L4) that this functional is bounded from below. 
The infimum of C{s,y;t,x) over fl{s,y;t,x) is called the value function of the 
action functional and is denoted by L{s,y;t,x). It is well-known (see, e.g., ^) 
that this infimum is attained, i.e., that there exists a trajectory ^q G f2(s, y; t, x) 
such that C{s, y; t, x)[^q] — L{s, y; t, x). This trajectory is called a minimizer of 
the functional C{s^ y; t, x). 

The Aubry-Mather theory ||l|, g, H, |0| deals with a generalization of the 
notion of minimizer to the case when s and t are allowed to be infinite, — c» < 
s < t < 00. Since the potential U(t, x) is periodic in i, we may assume that 
s and t are integer or infinite and consider any trajectory ^(t) only at integer 
moments of time: Xn = S.in). Any part of a minimizer is a minimizer itself; 
therefore the minimization problem for the action functional can be discretized: 

t-i 

y^ i(fc, Xk:,k+ l,Xk+i) -^ min . 

k—s 

It follows from periodicity of U{t, x) in t that L{k, y;k+l,x) = L{0, y; 1, a;) for 
any fc S Z; denote L{0,y; l,x) by L{y,x). 

If s = — oo or i = oo, then the above sum diverges. In this case the definition 
of minimizer is modified in the following way: a sequence {in}, n G Z, s < n < t, 
is said to be L-minimal if it has the following property: for all ni, n2 G Z, 
s <ni < n2 <t, and any set {j/n}, n = ni, ni + 1, . . . , n2, such that y„j = x^ 
s-nd y„2 = Xn2 

"2 — 1 n2 — 1 

^ L{Xn,Xn+l) < ^ L{yn,yn+l)- 
n^n\ n—n-i 

This definition is due to Aubry n, 0]; similar concepts are known in statisti- 
cal mechanics (ground states in lattice models, see, e.g., ||I^) and differential 
geometry (geodesies of type A |ll[ ||). 

It is clear that the definition of L-minimality does not change if L{y,x) is 
substituted by i(y, x) + a(jj — x) for any a G M. Consider an optimization 
problem of Bolza type 

-1 
s{x^n)+ ^ {L{xk,Xk+i) + a{xk- Xk+i)) ^ min, xq = x. (1) 

k— — n 

It follows from Bellman's principle of optimality that for any solution {x-n, 
X-n+i, ■ ■ ■ , Xq = x} oi this problem the following inclusion holds: 

x^k G argmin ((B"~'''s)(y) + L{y, X-k+i) + a{y - x^k+i)), (2) 

yes. 



where operator Ba is the so-cahed BeUman operator M, HJ] : 

{Bas){x) = min (s(y) + L{y, x) + a{y - x)). 

It is clear that any solution of the problem (nl) satisfies the condition of L- 
minimality. 

Now suppose that a function s'^{x) satisfies the following functional equation: 

{Bas'')ix) = min (s"(y) + L{y, x) + a{y - x)) = s"(a;) + A. (3) 

i/SR 

Then any solution of the problem (nl) can be extended as —n -^ — oo using 
formula (0) without violating the condition of L-minimality. Thus to estab- 
lish the existence of two-sided infinite minimizers (corresponding to the case 
when s = — oo, t = oo) it is sufficient to show that the initial point Xq = x 
can be chosen in such a way that it is possible to find the reverse extension 
{a;i,a;2, . . .} satisfying the condition of L-minimality. This program is carried 
out in sections 3 and 4 after proving a number of technical lemmas in section 2. 
We stress that the functional equation (|^), like many other formulas in cal- 
culus of variations and optimization, can be treated as linear over a special 
algebraic structure, an idempotent semiring Rmin |§1- By definition, Rmin = 
{M U {oo}, ©, 0}, where operations © and are defined as follows: a ® b = 
min{a, b} (in particular, a©oo = oo©a = a) and a Q b = a -\- b (in particular, 
a0oo = oo0a = oo). It can easily be checked that this structure satisfies 
axioms of an idempotent semiring with neutral elements oo and with respect 
to operations © and 0, respectively ||]. In this context, the Bellman operator 
assumes the form of a linear integral operator: 



{Bas){x) = min {s{y) +L{y,x)+a{y -x)) ^ / s{y) Q {L{y,x) + a{y - x)) 
1/eK J 

ym 

and the equation (13) defines its eigenfunction s°-{x) and eigenvalue A(a) & 113: 

iBas){x) = s{x) + X{a) = (A(a) s){x). 

This approach can be used further to re-establish the main results of Aubry- 
Mather theory in an independent way; however, in this paper, we assume a 
reverse viewpoint and apply Aubry-Mather theory to study of idempotent eigen- 
functions s°(x). One question that can be hard to resolve in the general setting 
of idempotent analysis is whether an eigenfunction corresponding to a given 
eigenvalue is unique. In section 5 we exploit minimality of Aubry-Mather set in 
the sense of topological dynamics to prove that in the case of irrational rotation 
number the eigenfunction is determined uniquely up to an additive constant. 
This result is sharp in the sense that if the rotation number is rational, then 
the solution may not be unique; a counterexample is constructed in M . 

This work was motivated by the preprint M , in which the problem was stated 
in terms of periodic solution to periodically forced Burgers equation rather than 



eigenfunction of Bellman operator. After the work was finished |13|, the author 
learned that in the context of the forced Burgers equation similar results, in- 
cluding uniqueness theorem, were obtained independently by Weinan E Iq]. 

The author is deeply grateful to Ya. G. Sinai for setting of the problem and 
constant attention to this work and to Weinan E for the opportunity to read 
the unpublished version of his paper. 

2 Properties of the value function 

The following result is classical in calculus of variations (see, e.g., Q): 

Lemma 1 Suppose Lq{v) and U{t,x) satisfy assumptions {Li)-{Li) and x, y, 
s, t ^ ^, s < t; then there exists a minimizer ^o £ ^(s,y;i,x) such that 
C{s,y;t,x)[^o] = L{s,y;t,x). If ^o G ^is,y;t,x) is a minimizer, then ^q is of 
class C^ in [s,t] and there exists a C^ function \: [s,i\ — > R such that 

A(r)-L'o(e^(r)), A'(r) = -^^^(^^1^, s<T<t. (4) 

For all R, s, t ^ M. such that R > 0, s < t and all x, y E M. such that 
\x — y\ < R{t — s) there exists a positive constant C'l — Ci{R,s,t) such that if 
^0 £ ^(Sj 2/5^7 2:) is a minimizer, then \Coi''')\ ^ C'l, s <t <t. 

Lemma 2 The function L{s,y;t,x) is diagonally periodic: 

L{s, ?; + 1; t, a; + 1) = L{s + l,y;t+l, x) = L{s, y; t, x). 



This lemma follows from periodicity of U{t,x) in t and x. 
Lemma 3 For all r, s, i, x, y G M, s < r < t, 

L{s, y; t, x) — min {L{s, y; r, z) + L{r, z; t, x)). (5) 

This is a variant of the well-known Bellman's principle of optimality. 
Lemma 4 The function L{s,y;t,x) satisfies inequalities 

-M<-^L{s,y;t,x)-Lo(^^^] <-m, (6) 

t ^ 3 \t — S / 

where m = min(t_a;)gR2 U{t,x), M = max(t_a;)gR2 U{t,x). 



Proof. Consider the functional 

C{s,y;t,xm^ f Lo{e{r))dT. 

J s 

The trajectory ^(t) — x{T~s)/{t — s)+y(t — r)/(t — s), s < r < t, is a minimizer 
of this functional in the set U,{s^y;t^x) and 

£(s, y; i, x) [^] = {t- s)Lo ( - 

Let fo be a minimizer of the functional C{s, y; t, x) in the class ri(s, y; i, a:), 
i.e., £(s, y; t, x)[£,o] = L(s, y; i, x). We have 

t X — V \ ^^ ^ 

L{s,y;t,x) - {t ~ s)Lq ( -^— ^ j ^ ^s,y;t,x)[£,o] - C{s,y;t,x)[^]) = 

U{T,^oiT)) dr + {C{s,y;t,x)[^o] - C{s,y;t,xm) > 



and 



> (t — s) — max U(t, x) 



L{s,y; t, x)-{t- s)Lq ( j— j = C{s,y;t,x) [fo] - ^s,y;t, x) [^] < 
< £{s, y; t, x) [f] - C{s, y; t, x) [f] = 

U(T,^(T))dT <(t-s)(~ min U(t,x) 

Multiplying these inequalities by (i — s)^^, we obtain (H). D 

Lemma 5 The function L{s,y;t,x) is locally Lipschitzian: if R, xi, X2, yi, 
j/2, s, t E R, s < t, R > 0, \xi — yj\ < R(t — s), i, j — 1,2, then there exists 
C = C{R, s, t) eR, C>0, such that 

\L{s,yi;t,xi) - L{s,y2;t,X2)\ < C{\yi - 2/2! + \xi ~ X2I). (7) 



Proof. It is sufficient to prove the inequality 

\L{s,y;t,Xi) - L{s,y;t,X2)\ < C\xi -X2I, (8) 

where \xi — y\ < R{t — s), i = 1,2. The inequality for the first pair of argu- 
ments of the function L is proved similarly; combining these two inequalities, 
wc obtain (|j). 



Let ^0 G il{s, y; t, Xi) be a minimizer of the functional £(s, y; t, xi). Consider 
the trajectory ^(r) = ^o(''') + (x2 — xi){t — s)/{t — s), s < t < t. It is clear that 
^ G ^{s,y;t,X2)- We have 



L{s,y;t,X2) ~ L{s,y;t,xi) < C{s,y;t,X2)[C] - C{s,y;t,xi)[^Q] = 



t- s 



dr- 



U ( T,eo(T) + ^2_^i(r -s)]^ U{T,Ur)) 



dr. 



The functions t/(t, x) and Lq{v) are of class C^; in addition, it follows from (L3), 
(L4) that |9[/(i,a;)/9a;| < A/i for some positive Afi G K. Hence, 



ioKoW + ^ 



F2 -2^11 



+ 



L{s,y;t,X2) ~ L{s,y;t,xi) < 

, \X2 -xi\ 
< (t — s) max 

t ~ S rG[s,t],|e|<l 

\x2^X,\{t~sr 

t-s 2 

By lemma 0, it follows that \^'o{t)\ < Ci = Ci{R,s,t), s <t <t. Also, by (Li), 
Lo(^') is finite for aU v; thus for some C = C{Mi,R, s,t) eR, C > 0, 

L{s,y;t,X2) - L{s,y;t,xi) < C\x2 - Xi\. 

Similarly, L(s,y;t,X2) — L(s,y;t,xi) > ~C'\x2 ~ xi\. This completes the proof 
of inequality (J^) . D 

Lemma 6 Let xi, X2, yi, y2, s, r, t €W, s < r < t; suppose there exists zq G M 
such that for all z €M. 

L{s,yi;r,z) + L{r,z;t,Xi) > L{s,yi;r, zq) + L(r, zq; t, x^), i = 1,2. 

Then either x\ = X2 and j/i = 1/2 or (xi — X2){yi — 2/2) < 0. 

Proof. For xi — X2 and j/i — y2 there is nothing to prove. Assume xi ^ X2 
or 2/1 ^ y2- Let £,f G 0(s, j/i;r, zq) and ^f" G fl{r, ZQ;t,Xi) be minimizers of 
functionals C{s, yi] r, zq) and /I(r, zq! ^j 2;^), j = 1, 2. It follows from the condition 
of the lemma and Bellman's principle of optimality (lemma ^) that for i = 1, 2 

L{s, y,] r, zo) + L{r, zq; i, Xi) = L[s, ?/»; t, a;^). 

Hence for i = 1, 2 the trajectories 

e<M, s<T<r 



Ur) 



S,f{T), r<T<t 



(Ci G Vl{s,y.i;t,Xi)) 



are minimizers of >C(s, y^; i,Xi). Using lemma Q we see that the trajectories ^i, 
i = 1,2, are of class C^ This means that [^<)'[r - 0) = {S>)'{r + 0) = S,[{r), 
z= 1,2. 



We claim that £,[{r) ^ ^i^t)- Indeed, let Ai, i — 1,2, be the C^ functions 
corresponding to trajectories ^i by lemma El Assume that ■fil'") — ^2(^)1 then, 
by continuity of -Lq(-), it follows from (^ that Ai(r) = Xiir). Consider the 
Cauchy problem for the system of ordinary differential equations (0) on the 
interval [s,i] with initial data ^q{j) = ^i(r) = ^i{r) and A(r) = \\{r) = A2(r). 
It follows from condition (L3) that the function dU{t, x)/dx is Lipschitzian and 
its absolute value is bounded by the constant Mi > 0; thus it follows from the 
second equation (^ that |A(t) — A(r)| < Miit — s) for all t G [s,t]- Hence it 
follows from condition (ii) that the system 

^a{V = [Lo) (A(t)), A(t) = — , s<T<t, 

which is equivalent to (^j, satisfies the conditions of the uniqueness theorem. 
Thus ^i(t) — ^2 (''■), s l£ T < t, and in particular xi = xi and y\ — y2- This 
contradiction proves that £,'i{r) ^ £,2[t)- 

Now we prove that there exists (5 > such that s < r — 6, r + S < t, and 
if T G (r — 5, r + 5), r ^ r, then ^i(r) 7^ ^2{t). Indeed, let a sequence {i„} be 
such that s < tn < t, i„ ^ r, ^i(in) — ^2{tn) for all n, and lim„_^oo tn = r. This 
implies that 

CAr) = hm ilM^ilM . lini i^M^Ml . e^(,), 

n^oc tn — r ri^oo tn — T 

a contradiction. 

Now assume that (xi — X2){yi — 2/2) > 0; to be precise, let xi < X2 
and 2/1 < 2/2- For i = 1,2 define trajectories ^i € fl{s,yi;t,Xi) by ^i(r) = 
min{^i(r),^2(''')} and f2(T) — max{^i(T),^2(T)}. By the above each of ^1 and 
^2 coincides with ^1 and ^2 on a finite number of intervals of finite length. Let 
us check that the trajectories ^i, i = 1,2, are minimizers. Indeed, we have 

C{s,yi;t,Xi)[Ci] > C{s,yi;t,Xi)[^i] = L{s,yi;t,Xi), i = 1,2, 

and 

C{s,yi;t,xi)[^i] +£{s,y2;t,X2)[^2] = 
= C{s,yi;t,xi)[^i] +C{s,y2;t,x2)[^2] = 
= L{s, yi; t,xi)+ L{s, ^2; t, 2:2). 

Therefore C{s,yi;t,Xi)[£,i] = L{s,yi;t,Xi), i = 1,2. 

By lemma || the trajectories ^i, i = 1, 2, are of class C^. This implies that 
^ii^ ^ 0) = Ci{i^ + 0), i = 1,2, where all one-sided derivatives exist. But this 
means that ^[{r — 0) = ^2('' + 0) and £_'2{r — 0) = Cii^ + 0), since r is the only 
intersection point of ^1 and ^2 in the interval (r ~ S,r + S). Thus Ci{t) = ^2('')- 
This contradiction concludes the proof. D 

Corollary Let xi, X2, yi, y2, s, t e M, xi < X2, 2/1 < 2/2, o,nd s < t. Then 

L{s, 2/1; i, xi) + L{s, 2/2; t, X2) < L(s, 2/2; t, xi) + L{s, yi;t, X2). (9) 



7 



Proof. Let ^i S Vl{s,yi;t,X2) and ^2 £ ^{s,y2',t,Xi) be minimizers of func- 
tionals £-{s,yi;t,X2) and£(s, j/2; i, 2:1), respectively. Note that ^i(s) < ^2(3) and 
^i(t) > ^2{t)': hence there exist r and zq such that s < r < t, ^i(r) = C2(^) = 
zo- Thereiore L{s,yi;r,zo) + L{r,zo;t,X2) = L{s,yi;t,X2), L{s,y2;r,zo) + 
L{r,zo;t,xi) = L{s,y2;t,xi) and hy lemma.^ L{s,yi;r, zq) + L{r, zo;t,xi) > 
L{s,yi;t,xi), L{s,y2;r, zq) + L{r, zo;t,X2) > L{s,y2]t,X2). This imphes that 
L{s, 1/1; t, xi) + L{s,y2]t,X2) < L(s,yi; t,X2) + L{s,y2] t, xi). Assume that this 
inequahty is actually an equality. This assumption means that for all z G R 

L{s, yi;t, xi) = L(s, j/i; r, zq) + L{r, zq; t, xi) < L(s, yi;r, z) + L{r, z; t, Xi), 
L{s, y2;t, X2) = i(s, y2;r, zq) + L{r, zq; t, X2) < L(s, y2] r, z) + L{r, z; t, X2). 

It follows from the previous lemma that (xi — a;2)(yi — 2/2) < 0. This contradic- 
tion concludes the proof. D 

3 Existence of an eigenfunction of the Bellman 
operator 

Let a e M, so{x) be a continuous periodic function. We define 

Sn{x; a, So) = (S"so)(a;) = min {so{y) + i(0, y; n, x) + a{y - x)). 

As a function of x, Sn{x;a, sq) is bounded from below. Further, it follows 
from diagonal periodicity of L{s,y;t,x) (lemma ||) that it is periodic; thus 
Sn{x;a,so) = min^g^ Sn{x — k;a,so). Using this formula, lemma g, and pe- 
riodicity of so(y), we get 

s„(x; a. So) = min min (so(j/) + L{0, y + k;n,x) + a(y + fc — x)). 

Thus for any n > and y, x G R the quantity L(0, y + k; n, x) + a{y + fc — a;) is 
bounded from below as a function of fc e Z. We denote 

Kiv.x) ^ i-nin{L{0,y + k;n,x) + a{y + k - x)), (10) 

where minimum is attained since L{s, y; t, x) is continuous and grows arbitrarily 
large as \x — y\ ^ 00; hence, 

Sn{x;a,so) ^mm{so{y) + L'^{y,x)). (11) 



Lemma 7 For any n — 1,2, ... , the function L'^iy, x) is periodic in both vari- 
ables and Lipschitzian in x; the Lipschitz constant C*{a) does not depend on n 
and y £ R. For any ni > 0, 71.2 > 

K,+n., {y. ^) = nun (L«^ (y, z) + L^^ (z, x)). (12) 

2 tM 



Proof. Using the definition inu) and lemma 0, we obtain L°(y + l,x + m) = 
L'^{y,x) for any integer I, m; thus L'^{y,x) is periodic. Combining ( p^ ) for 
n = ni + 712 with Bellman's principle of optimality (0) for s = 0, r = ni, and 
i = ni + n2 and using lemma 0, we get 

K^+n2 (y^ ^) = min (^ni (y> 2;) + L(0, z; n^, x) + a(z - x)). 

Using periodicity of Lf-^^{y, z) in z, we obtain (p^). 

Let us prove that L1{y,x) is Lipschitzian. Since Lf{y,x) is a pointwise 
minimum of a family of continuous functions, it is upper semicontinuous. Denote 
by N the maximum value of Li{y, x) on the set Q = {{y,x)\0<y<l,0< 
X < 1}. Clearly, there exists R > such that Lq{x — y — k) + a{y + k — x) > 
N + max(j ,r^£R2 U{t,x) for all {y,x) G Q whenever |fc| > R. Thus it follows 
from lemma |4| that for any {y,x) G Q 

Li(y,x) ^ min (L(0,y + k;l,x) + a(y + k — x)). 

keZ,\k\<B. 

On the other hand, using lemma o, we see that all functions i(0, y + k;l,x) + 
a{y + k — x), \k\ < R, are Lipschitzian on Q with the constant C*{a) = C{R + 
1,0,1) + \a\. Thus Li{y,x) is Lipschitzian on Q (and, by periodicity, on the 
whole M^) with the same constant. 



Now it follows from (12) that for any n>2 



Lniy, a;) = min (L^_i(y, z) + Ll{z, x)), 

that is for any y G M L'^{y, x) as a function of x is a pointwise minimum of a 
family of functions having the same Lipschitz constant C*{a). Thus L'^{y^x) is 
Lipschitz continuous in x with the constant C*{a) for all n = 1, 2, . . . D 

Corollary For any n = 1,2, . . . the function Sn{x; a, sq) defined in ( jj j| j is Lip- 
schitzian with the constant C*{a); it satisfies 

max s„(x; a, sq) — min Sn{x; a, sq) < C*{a) (13) 

and for all m ^ "L, m> n, 

Smix; a. So) = min (sm_„(y; a, sq) + L'^{y, x)). (14) 

yes. 



Proof. From (O) it follows that Sn{x;a,so) is a pointwise minimum of a 
family of Lipschitzian functions having the Lipschitz constant C*{a); hence 
it is Lipschitzian with the same constant. Taking into account periodicity of 
Sn{x;a,so), we obtain (^). Equation (nlf) follows from (n2|) for ni — m — n, 

712 = n. n 

Denote 

1 /l y — x\ 
Xn{a) — min —U^{y,x)= min { —L{{),y;n,x) + a 1. (15) 



(j/,a;)eR2 ji (j/,a;)eR2 V n n 



Lemma 8 For any a ^M. there exists A (a) G M such that 

|A„(a)-A(a)|<^-^, (16) 

n 

where C*{a) is the Lipschitz constant of the function L"(2/, x). The function 
a t—f A (a) is concave and satisfies inequalities 

Ho{a) +m< -A(a) < Ho{a) + M, (17) 

where m and M are defined in lemma [J and Hq (a) is the Legendre transform 
ofLoiv). 

Proof. Let so{x) — 0, s„(a;) = s„(a;;a, sq). From (|lj), for any integer n, no, 
< no < 71, 

Sn{x) =miri(s„_„„(y)+L^„(y,x)). (18) 

We see that niinj;gR Sn{x) — niin(j, ,j,)gR2 L'^{y, x) — nA„(a) for any n = 1, 2, . . . 
It follows from the corollary to lem ma \1\ that nA„ (a) < s„ (x) < nA„ (a) + C* (a) . 
Combining these inequalities with ( |l8|) and ([iq), we obtain 

nA„(a) < s„(x) < (n - no)A„_„o(a) + C*(a) +noA„„(a), 
(n-no)A„_„(,(a) +noA„„(a) < s„(a;) < nA„(a) + C*{a). 

Hence, 

|nA„(a) - noA„„(a) - (n - no)A„_„o(a)| < C*{a). 

There exist integer p > I and < g < n such that n ~ pn^ + q. By induction 
over p it is easily checked that |nA„(a) — pn^Xng (a) — qXq{a)\ < pC*{a), that is 



q 



Xn{a) - Xnoia) + ^{XnM - \ia)) <-C*ia)<—C*{a). (19) 



n 



P^*._^ . 1 



n no 



Let e > be arbitrarily small, uq be so large that the right-hand side of this 
inequality is less than e, and N be such that (1/iV) maxi<g<„(, \q{Xn„{a) — 
Xq{a)\ < e; then |A„i(a) — A„2(a)| < 4e for all ni, n2 > N. Thus {A„(aU, 
n = 1,2,..., is a Cauchy sequence. Denote its limit by A(a); then we get ( |l6[) 
from (|l9| ) in the limit n — > oo. 

Suppose ai, 02 ^ R, < a, P < I, a + P — 1. Using definition of A„(a) (|l5|), 
we obtain 

A„(aai + /3a2) = — min (i(0, y; n, x) + (aai + (3a2){y — x)) — 

= — min [a{L(0,y;n,x) + ai{y ~ x)) + P{L{0,y]n,x) + a{y — x))) > 

n (y,x)&K? 

> aA„(oi) + PXn{a2). 
In the limit n ^ oo this implies that the function A (a) is concave. 
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Finally, lemma H implies that —M < (l/n)L(0, y; n, x)~Lo{{x—y)/n) < — m. 
Hence, 

x — y ^ f X — y\ a; — wl^,„ , ,^ x — y^ (x — y 
m+a --Lo < a L{0,y;n,x) < M+a --Lq ' 



n \ n J n n n V'^ 

Taking max over {y, x) £ R^, using (Eq), and denoting (x — y)/n by v, we obtain 
m + max (av — L(j{v)) < — A„(a) < M + max (av — Lq{v)). 

But by a well-known formula for the Legendre transform max^gR {av ~ Lo{v)) = 



Ho^a). Thus we obtain (17) in the limit n —f cxo. D 



Theorem 1 Suppose a G M and so{x) is a continuous and periodic function; 
then there exists 

liminf (s„(x; a, sq) — nX{a)) = s°'{x) (20) 

n — >cxD 

and s°'{x) satisfies functional equation (0). 

Proof. Using definitions of s„(x; a, sq) and A„(a), we get 

min soiy) + nX„{a) < s„(x; a, sq) < max so{y) + nA„(a). 

yes. y£M 



Subtracting nX{a) and using (16), we obtain 



min so{y) — C*{a) < Sn{x; a, so) — riA(a) < max so(y) + C*{a). 
y€M. y^R 

Let 

Snix) = inf (sm(x;a,so) - mA(a)), n=l,2, 

For any a; G M the sequence {sn{x)} is nondecreasing; we see that it is bounded. 
Further, the corollary to lemma M implies that all functions s„(a;) are Lips- 
chitzian with the constant C*{a); hence, this sequence is equicontinuous. It 
follows that there exists 

lim Sn{x) = liminf (s„(a;; a, sq) — nX{a)) — s°'{x) 

n — >oo n — xyo 

and s°'{x) is periodic and continuous. 

Let us check that s°'{x) satisfies functional equation (^. We have 

min {sn{y) + L1{y, x)) - A(a) = 

j/SK 

= min ( inf (min (so(z) + i^(z, y) + Ll{y, x) - (m + l)A(a)))). 

yf^M. m>n zGR 

But it follows from the definition of A„(a) and lemma || that Lf^{z, y) — niX{a) > 
—C*{a) for all TO =: 1,2,... Therefore we can take minimum over y G M before 
infimum over m > n and obtain 

mm {sn{y) + Ll{y,x)) - A(a) = Sn+i{x). 

Taking into account (HG) and passing to the limit n ^ oo, we see that s"(x) 
satisfies functional equation (pi). D 
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4 Existence of two-sided minimizers 

Suppose a G M, s°'{x) is a continuous periodic function satisfying functional 
equation (0). Denote La{y,x) = L(0,y; l,x) + a{y — x) — A(a). Let Y"'{x) be 
the many- valued map of R to R defined as 

Y'^ix) - argmin (^'^(y) + La{y. x)). (21) 

yes. 

It is readily seen that if a;, y G R, then y G Y°-{x) iff 

s"(y) + ia(2/, x) = s'^la:) = min (s'^(z) + L,(z, a;)). (22) 

For any two sets X C R, F C R, denote by X + F the set { z G R | z = 
X + y,x € X,y eY}. If F = {y}, we denote X + {y} hy X + y. 

Lemma 9 For all x &M. 

^''(a; + 1) = r"(a;) + 1. (23) 

// there exists zq G R such that x G Y°'{xo), then the set Y°'{x) contains only 
one point. If xi, X2, yi, j/2 G R, a;i < a;2 7 2/i G ^"'{xi); a'^'^ y2 G Y°-{x2), then 
yi <y2- 

Proof. Equation (03) follows from periodicity of s°'{x) and diagonal periodicity 
oiLa{y,x) (lemma g). 

Suppose a^i < X2 and yi G Y°-{xi), i — 1,2. By (p^), it follows that 

s'^iyi) + L{0, yi; 1, xi) + ayi < s°-{y2) + £(0, 2/2; 1, ^i) + ay2, 
s°'{y2) + i(0, y2] 1, X2) + 02/2 < s''(2/i) + i(0, 2/1; 1, X2) + ayi, 

that is 

i(0,2/i;l,a;i) + L(0, j/2; 1,2:2) < L(0, 1/2; l,a;i) + L(0,2/i; l,a;2)- 

Thus it follows from the corollary to lemma O that yi < j/2 ■ 

Let us check that yi < y2- Assume the converse; let y ~ yi =2/2- Take any 
yo G >'°(y)- By (H), it follows that 

s'^(x,) = 5^(2/0) + i(0, 2/0; 1, y) + i(l, 2/; 2, X,) + a(yo - x^) - 2\{a), i = 1,2. 

On the other hand, using (H), we get 

s'^{xi) = minmin («"(*) + L{0,t;l,z) + L{1, z;2,Xi) + a{t - Xi) - 2A(a)) < 
< min (s"(yo) + -^^(0, j/o; 1, z) + L{1, z; 2, x^) + a{yo - Xi) - 2A(a)), 
i = 1,2. 

Hence it follows from lemma n that xi = X2', this contradiction proves that 
yi < y2- 

Finally, suppose x G Y'^{xo) for some xo G R and j/i, 2/2 G F°(a;). By a 
similar argument, we see that yi — y2- Thus K" (x) consists of a single point. D 
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Lemma 10 Suppose Mq = R, M„ = F"(M„_i), n = 1,2,...; then Mq D 
Ml D M2 D . . . and there exists a nonempty closed set M°' such that (i) Af " = 
n^o -^"'' (^^) f'^''' ^'"•y open [/ C M such that M°- C U + Z there exists N > 
with the following property: if the sequence {yn} is such that yn+i G ^"(j/n), 
n = 0, 1, . . . , then yn & U + "E for all n > N; (Hi) the restriction Y"-\m'' of ¥"■ 
to M"" is a one-to-one continuous mapping with continuous inverse. 

Proof. Evidently, all M„ ^ and Mq — R contains Mi. Suppose M„ C M„_i 
for some n > 1, a; G M„; then ^(x) C F"(M„) C y(Af„_i) = A'f„. Hence 
Mn+i^Y^{Mn)cMn. 

Let us show that all M„, n — 1,2, ... , are closed. Note that Mq = M is closed. 
Suppose Af„ is closed and the sequence yk G Mn+i, k = 1,2, . . . , converges to 
a limit y € M.. It follows from lemma that for any k there exists a unique 
Xk = {Y'^)~^{yk) G Mn and all Xk are contained in a bounded interval. Thus 
there exists a subsequence {a;^, } that converges to a limit x € A/„. Using (p2|), 
we get 

s" (2;fe, ) + ia (yfc, , a;fc, ) = s° (xfc J . 

Since the finctions s''(x) and La{y,x) are continuous, we obtain 

s\v) + La{y,x)^s'^[x). 



Now it follows from (g2|) that y G Y^ix). Hence y e F" (Af„) = M„+i, that is 
Ar„+i is closed. 

Consider the topology T on M such that V ^ T iS V = U + "L, where U 
is open in the usual sense. Note that K is compact in this topology. It follows 
from (p3) that complements t/„ of sets Af„ are open in the topology T. We see 
that Un C Un+l. 

Clearly, the set M"' = H^o -^^" ^^ closed. Let us check that it is nonempty. 
Assume the converse; hence sets f/„, n = 1,2, . . . cover all M. Since M is compact 
in the topology T, we see that there exists iV > such that R = IJn=o ^" ~ ^^'■ 
Thus Mn = 0; this contradiction proves that Af° is nonempty. 

Now let F £ T be such that Af " C V. Arguing as above, we see that there 
exists A^ > such that M = V U Un- On the other hand, for any sequence {yn} 
such that y„+i G !""(?/„), n = 0, 1, ... , it follows that y„ G Af„. Thus for all 
n > N we obtain y„ G V. 

Denote by F" |m„: Af„ -^ Af„+i the restriction of F" to A/„, n = 1,2, . . . 
It follows from lemma ^ that ^ |m„ is single- valued, strictly increasing as a 
function M — > K, and bijective. We claim that it is a homeomorphism. Indeed, 
let sequences {2;^} C Af„ and {yk} C Mn+i be such that Y°-{xk) = yk for all k. 
If yk converge to y, then it follows from strict monotonicity of y"|Af„ that Xk 
converge to a unique x; hence the map Y'^\m„ has a continuous inverse. Further, 
if Xk converge to x, then the set {yk} is bounded. Let yi, y2, yi 7^ 2/2, be two 
limit points of {yk}', then we see that {2/1,^2} C Y"-{x), since s"'{x) and La{y, x) 
are continuous. But the map y |7\/„ is single- valued; this contradiction proves 
that it is continuous. 
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By the above M" is a closed subset of M„ for all n — 1,2...; in addition, 
y^iM") = M"-. It follows that the restriction of F°|m„ to Af° is a homcomor- 
phism. D 

We say that M°- is the invariant set of the many- valued map Y°- (x) . 

Combining the previous lemma with the observation that sequence {a;„} that 
satisfies (0) is L-minimal, we obtain the following 

Theorem 2 Suppose a G M, s"(a;) is a continuous periodic function satisfying 
functional equation ^, Y"'{x) is the corresponding many-valued map, M° is 
its invariant set, and x G M°. Then the two-sided sequence Xk — {Y°')~^{x), 
A; G Z, is L-minimal. 



5 Uniqueness of an eigenfunction 

To give the uniqueness condition for eigenfunction of the Bellman operator we 
need the following results of Aubry-Mather theory: 

Lemma 11 Suppose a sequence {x„}, n G Z, is L-minimal; then there exists 

lira ^" ~ ^° = Lu{{xn}) G M. (24) 

n— *±oo Tl 

If uj = ijj{{xn}) is irrational, then there exists a function (j)uj{t)' K ^ R with 
the following properties: (i) it is continuous on the right and 4>u>{ti) < 4'u>{t2) 
iffti < ia; (a) <t)u{t + 1) = (j)uj{t) + 1 for all t G R; (Hi) if xa = 0„(io ± 0) 
then the sequence {xn} defined by Xn — ^^(^o + i^^ i 0) is L-minimal; (iv) for 
any neighborhood V € T of the closure of the image 0(j(K) and any L-minimal 
sequence {xn}, a;„ G V as soon as \n\ is large enough. 

For the proof see, e.g., ||l^, sections 9, 11, and 12]. The number u!{{xk}) is called 
a rotation number of the L-minimal sequence {xk}- 

Theorem 3 Let s°'{x) be the continuous periodic function satisfying functional 
equation ^, V^^x) be the corresponding many-valued map and Af" be its in- 
variant set. Then the value of lj for any L-minimal sequence of the form 
Xn — 0^°") {x) depends only on the parameter a but not on the choice of 
s°'{x); furthermore, if Lo{a) is irrational, then s"'{x) is determined uniquely up 
to an additive constant. 

Proof. Let Y°'{x) be a many- valued map corresponding to a countinuous 
periodic function s°-{x) satisfying functional equation (|3|) and Af ° be its invariant 
set. The corresponding rotation number uj is determined uniquely. Indeed, let 
Xk = {Y'')~'^{x) and yk = {Y°')~'^{y), k ^ Z, for some x, y G M"; we are going 
to demonstrate that oj{{xk}) — LLj{{yk})- Takep G Z such that x < y+p < x-f-l. 
By lemma |, it follows that (Y^y^ix) < (Y'^y'^iy +p) < {Y"-)-^{x + l) for aU 
A: G Z. Using (|2^), we obtain Lu{{xk}) — uj{{yk}). 

A subset M C M° is called a minimal set of the (single-valued) map Y'^Im" 
if M is closed, Y°'{M) — M, and M contains no other nonempty subset with 
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the same properties. Let x G M"; the sequence {(Y'°)'^(a;)}, k — 1,2,..., is 
called the orbit of the point x. It can be proved that a set M C M" is minimal 
if and only if the orbit of any point a; e M is dense in M in topology T defined 
in the proof of lemma O. 

The set M" is compact in topology T; using (p3|), we see that V^ is a home- 
omorphism of AI" in this topology. By the well-known theorem of Birkhoff B , 
it follows that M" contains at least one minimal set M of the map ¥"■. 

Suppose Si{x) is another continuous periodic function satisfying functional 
equation (||); then for all x, y G R such that y G Y°-{x) 

s^{x)~sUx)>s^{y)-sUy). 
Indeed, it follows from (g^) that s°-{x) — s°-{y)+La{y, x). Using (|ll|), we obtain 

s^ix) - s^x) = s-{y) + Laiy, x) - s1{x) = 

= 4(y) + Laiy, x) - s^,{x) + s^y) - s^y) > 
>s-{y)-sUy). 

Clearly, s°-{x) and s°(a;) are continuous in topology T. Let xq G M be a 
point where s°'{x) — s1{x) attains its minimal value in M and {.Xfe}, fc = 1, 2, . . . , 
be its orbit. By the above, 

s"(a;o) - s1{xo) < s"(xfe) - s?(a;fc) < s^{xo) - s?(xo). 

Since the closure of {a:^} is the set M, we see that on Af s"" (x) — s1{x) is constant. 
Thus it follows from ( |2^ ) that on the set M ^{x) coincides with the map Y^{x) 
corresponding to Si{x). In particular, the rotation number w depends only on 
a. We see also that if M is a minimal set of the map corresponding to some 
s°'{x) satisfying functional equation (0), then it is a minimal set of any other 
continuous periodic function satisfying functional equation (0) with the same a. 



Now suppose to = uj{a) is irrational. It follows from lemma 11 (iv) that the 
closure M of the set (j)uj (R) contains hmit points with respect to topology T of 
the closed set M°, so M n M° is nonempty. Now if xq G M° and there exists 
such to that xq — 4>^(to ± 0) G M, then by lemma ^ (in) the closure of the 
orbit of the point a:o with respect to topology T coincides with M, so M C M". 
Thus statement (iv) of lemma |ll| means that M is the only minimal invariant 
subset of M" not depending on the particular choice of an eigenfunction s" (x) . 

Finally let us prove that if oj = LLi{a) is irrational, then s°-{x) — s'l{x) is 
constant for all a; G M. Without loss of generality it can be assumed that 
s°'{x) — Si{x) = on M. Let a;o G R be a point where s°'{x) — sf{x) attains 
its minimum in Af ° and {xk}, fc = 1, 2, . . . , be its orbit. Arguing as above, we 
see that s°'{xk) — s°(xfc) — s'^{xo) — Si(xo) for all fc > 1. On the other hand, it 
follows from lemma O (iv) that for any neighborhood V^ G T of the set M there 
exists A^ > such that Xk & V for all k > N. Using continuity of the functions 
s°(x) and Si(a;), we see that s'^{xo) — Si{xo) — 0. By definition of xq, it follows 
that s^ix) > s1{x) for all a; G Af". Likewise, s^ix) < s1{x); thus s^ix) = s1{x) 
on Af". A similar argument based on lemma M (ii) shows that s"(x) = s^^x) 
for all a; G R. D 
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